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METHOD AND APPARATUS FOR PARTITIONING A RESOURCE BETWEEN 
MULTIPLE THREADS WITHIN A MULTI-THREADED PROCESSOR 



FIELD OF THE INVENTION 

The present invention relates generally to the field of multi-threaded 
processors and, more specifically, to a method and apparatus for partitiorung 
a processor resource within a multi-threaded processor. 

BACKGROUND OF THE INVENTION 

Multi-threaded processor design has recently been considered as an 
increasingly attractive option for increasing the performance of processors. 
Multithreading within a processor, inter alia, provides the potential for more 
effective utilization of various processor resources, and particularly for more 
effective utilization of the execution logic within a processor. Specifically, by 
feeding multiple threads to the execution logic of a processor, clock cycles 
that would otherwise have been idle due to a stall or other delay in the 
processing of a particular thread may be utilized to service another thread. A 
stall in the processing of a particular thread may result from a number of 
occurrences within a processor pipeline. For example, a cache miss or a 
branch missprediction (i.e., a long-latency operation) for an instruction 
included within a thread tj^ically results in the processing of the relevant 
thread stalling. The negative effect of long-latency operations on execution 
logic efficiencies is exacerbated by the recent increases in execution logic 
throughput that have outstripped advances in memory access and retrieval 
rates. 

Multi-threaded computer apphcations are also becoming increasingly 
common in view of the support provided to such multi-threaded applications 
by a number of popular operating systems, such as the Windows NT® and 
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Unix operating systems. Multi-threaded computer applications are 
particularly efficient in the multi-media arena. 

Multi-threaded processors may broadly be classified into two 
categories (i.e., fine or coarse designs) according to the thread interleaving or 
switching scheme employed within the relevant processor. Fine multi- 
threaded designs support multiple active threads within a processor and 
typically interleave two different threads on a cyde-by-cyde basis. Coarse 
multi-threaded designs tj^ically interleave the instructions of different 
threads on the occurrence of some long-latency event, such as a cache miss. A 
coarse multi-threaded design is discussed in Eickemayer, R.; Johnson, R.; et 
al., "Evaluation of Multithreaded Uniprocessors for Commerdal Application 
Environments", The 23rd Annual International Symposium on Computer 
Architecture, pp. 203-212, May 1996. The distinctions between fine and coarse 
designs are further discussed in Laudon, J; Gupta, A, " Architectural and 
Implementation Tradeoffs in the Design of Multiple-Context Processors", 
Multithreaded Computer Architectures: A Summary of the State of the Art. 
edited by R.A. lannud et aL, pp. 167-200/Kluwer Academic Publishers, 
Norwell, Massachusetts, 1994. Laudon further proposes an interleaving 
scheme that combines the cycle-by-cyde switching of a fine design with the 
full pipeline interlocks of a coarse design (or blocked scheme). To this end, 
Laudon proposes a "back off instruction that makes a spedfic thread (or 
context) unavailable for a specific number of cydes. Such a "back off 
instruction may be issued upon the occurrence of predetermined events, such 
as a cache miss. In this way, Laudon avoids having to perform an actucd 
thread switch by simply making one of the threads unavailable. 

Where resource sharing is implemented within a multi-threaded 
processor (i.e., there is limited or no duplication of function units for each 
thread supported by the processor) it is desirable to effectively share 
resources between the threads. 
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BRIEF DESCRIPTION OF THE DRA WTMHS 

The present invention is illiistrated by way of example and not limited 
in the figures of the accompanying drawings, in which like references indicate 
similar elements and in which: 



Figure 1 is a block diagram illustrating an exemplary pipeline of a 
processor within which the present invention may be implemented. 

Figure 2 is a block diagram illustrating an exemplary embodiment of a 
processor, in the form of a general-purpose multi-threaded 
microprocessor, within which ttie present invention may be 
implemented. 



Figure 3 is a block diagram illustrating selected components of an 
exemplary multi-ihreaded microprocessor, and specifically depicts 
various functional imits that provide a buffering (or storage) capability 
as being logically partitioned to accommodate multiple thread. 

Figure 4 is a block diagram showing furtiier details regarding various 
components of an exemplary trace delivery engine (IDE). 

Figure 5 is a block diagram illustrating further architectural details of 
an exemplary trace cache fill buffer. 

Figure 6 is a block diagram illushrating further architectural details of 
an exemplary brace cache (TC). 

Figure 7 is a block diagram illustrating further structural details of an 
exemplary trace cache (TC) 
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Figure 8 is a block diagram illustrating various inputs and outputs of 
exemplary thread selection logic. 

Figure 9 is a block diagram illustrating three exemplary components of 
exemplary thread selection logic in the form of a thread selection state 
machine, and a coimter and comparator for a second thread. 

Figure 10 is a state diagram illustrating exemplary operation of an 
exemplary thread selection state machine. 

Figure 11 is a block diagram illustrating architectural details of an 
exemplary embodiment of victim selection logic. 

Figure 12 is a flow chart illustrating an exemplary method of 
partitioning a memory resotirce, such as for example a trace cache^ 
within a multi-threaded processor. 

Figure 13 is a flow chart illustrating an exemplary method of 
partitioning a resource, in the exemplary form of a memory resource, 
utilizing a Least Recently Used (LRU) history associated with the 
relevant memory resource. 

Figure 14 is a block diagram illustrating an exemplary LRU history 
data structure. 

Figure 15 is a block diagram illustrating further details pertaining to 
inputs to, and outputs from, exemplary victim selection logic. 
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DETAILED DESCRIPTION 

A method and apparatus for partitioning a processor resource within a 
mtalti-threaded processor are desaibed. In the following desaiption, for 
purposes of explanation, numerous specific details are set forth in order to 
provide a thorough understanding of the present invention. It will be 
evident, however, to one skilled in the art that the present invention may be 
practiced without these specific details. 

For the purposes of the present specification, the term "event" shall be 
taken to include any event, internal or external to a processor, that causes a 
change or interruption to the servicing of an instruction stream (macro- or 
micro-instruction) within a processor. Accordingly, the term "event" shall be 
taken to include, but not linruted to, branch instructions, exceptions and 
interrupts that may be generated within or outside the processor. 

For the purposes of the present specification, the term "processor" shall 
be taken to refer to any machine that is capable of executing a sequence of 
instanictions (e.g., macro- or micro-instructions), and shall be taken to indude, 
but not be limited to, gaieral purpose microprocessors, special purpose 
miCToprocessors, graphics controllers, audio controllers, multi-media 
controllers and microcontrollers. Further, the term "processor" shall be taken 
to refer to, inter alia, Complex Instruction Set Computers (CISC), Reduced 
Instruction Set Computers (RISC), or Very Long Instruction Word (VLIW) 
processors. 

For the purposes of the present specification, the term "resource" shall 
be taken to include any urxit, component or module of a processor, and shall 
be taken to include, but not be limited to, a memory resource, a processing 
resource, a buffering resource, a communications resource or bus, a 
sequencing resource or a translating resource. 
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Processor Pipeline 
Figure 1 is a high-level block diagram illustrating an exemplary 
embodiment of processor pipeline 10 within which the present invention may 
be implemented. The pipeline 10 includes a number of pipe stages, 
commencing vnth a fetch pipe stage 12 at which instructions (e.g., 
macroinstructions) are retrieved and fed into ti\e pipeline 10. For example, a 
maaoinstruction may be retrieved hrom a cache memory that is integral with 
the processor, or closely associated therewitti, or may be retrieved from an 
external main memory via a processor bus. From the fetch pipe stage 12, the 
macroir\structions are propagated to a decode pipe stage 14, where 
maaouistructions are translated into microinstructioi\s (also termed 
"microcode") suitable for execution within the processor. The 
microinstructions are then propagated downstream to an allocate pipe stage 
16, where processor resources are allocated to the various microinstructions 
according to availability and need. The miaoinstructions are then executed 
at an execute stage 18 before being retired, or "written-back" (e.g., committed 
to an architectural state) at a retire pipe stage 20. 

Microprocessor Architecture 
Figure 2 is a block diagram illustrating an exemplary embodiment of a 
processor 30, in the form of a general-purpose microprocessor, within which 
the present invention may be implemented. The processor 30 is described 
below as being a multi-threaded (MT) processor, and is accordingly able 
simultaneously to process multiple instruction threads (or contexts). 
However, a number of the teachings provided below in the specification are 
not specific to a multi-threaded processor, and may find application in a 
single threaded processor. In an exemplary embodiment, the processor 30 
may comprise an Intel Architechire (I A) microprocessor that is capable of 
executing the Intel Architecture instruction set. An example of such an Intel 
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Architecture nrucroprocessor is the Pentium Pro ® microprocessor or the 
Pentium III (D microprocessor manufactured by Intel Corporation of Santa 
Clara, California. 

The processor 30 comprises an in-order front end and an out-of-order 
back end. The in-order front end includes a bus interface unit 32, which 
functions as the conduit between the processor 30 and other components (e.g., 
main memory) of a computer system within which the processor 30 may be 
employed. To this end, the bus interface unit 32 couples the processor 30 to a 
processor bus (not shown) via which data and control information may be 
received at and propagated from the processor 30. The bus interface imit 32 
includes Front Side Bus (FSB) logic 34 that controls commimications over the 
processor bus. The bus interface unit 32 further includes a bus queue 36 that 
provides a buffering function with respect to communicatiorts over the 
processor bus. The bus interface imit 32 is shown to receive btis requests 38 
from, and to send snoops or bus returns 40 to, a memory execution unit 42 
that provides a local memory capability within the processor 30. The memory 
execution imit 42 includes a unified data and instruction cache 44, a data 
Translation Lookaside Buffer (TLB) 46, and memory ordering buffer 48. The 
memory execution unit 42 receives instruction fetch requests 50 from, and 
delivers raw instructions 52 (i.e., coded macroinstructions) to, a 
microinstruction translation engine 54 that translates the received 
macroinstructions into a corresponding set of microinstructions. 

The microinstruction translation engine 54 effectively operates as a 
trace cache "miss handler" in that it operates to deliver microinstructions to a 
trace cache 62 in the event of a trace cache miss. To this end, the 
microinstruction translation engine 54 functions to provide the fetch and 
decode pipe stages 12 and 14 in the event of a trace cache miss. The 
microinstruction translation engine 54 is shown to include a next instruction 
pointer (NIP) 100, an instruction Translation Lookaside Buffer (TLB) 102, a 
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branch predictor 104, an instruction streaming buffer 106, an instruction pre- 
decoder 108, instruction steering logic 110, an ii\struction decoder 112, and a 
branch address calculator 114. The next ii\struction pointer 100, TLB 102, 
branch predictor 104 and instruction streaming buffer 106 together constitute 
a branch prediction unit (BPU) 99. The instruction decoder 112 and branch 
address calculator 114 together comprise an instruction translate (IX) unit 113. 

The next instruction pointer 100 issues next instruction requests to tiie 
uiufied cache 44. In the exemplary embodiment where the processor 30 
comprises a multi-threaded microprocessor capable of processing two 
threads, the next instruction pointer 100 may include a multiplexer (MUX) 
(not shown) that selects between ii\struction pointers associated with either 
the first or second thread for inclusion within the next instruction request 
issued therefrom. In one embodiment, the next instruction pointer 100 will 
interleave next instruction requests for the first and second threads on a cyde- 
by-cyde ("ping pong") basis, assuming instructions for both threads have 
been requested, and instruction streaming buffer 106 resources for both of the 
threads have not been exhausted. The next instruction pointer requests may 
be for either 16, 32 or 64-bytes depending on whether the initial request 
address is in the upper half of a 32-byte or 64-byte aUgned line. The next 
instruction pointer 100 may be redirected by the branch predictor 104, ttie 
branch address calculator 114 or by the trace cache 62, with a trace cache miss 
request being the highest priority redirection request. 

When the next instruction pointer 100 makes an instruction request to 
the uiufied cache 44, it generates a two-bit "request identifier" that is 
assodated wifli the instruction request and functions as a "tag" for the 
relevant ii\struction request. When returning data responsive to an 
insbruction request, the imified cache 44 returns the following tags or 
identifiers together with the data: 

1 . The "request identifier" supplied by the next instruction pointer 
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100; 

2. A three-bit "chunk identifier" that identifies the chunk returned; 
and 

3. A "thread identifier" that identifies the thread to which the 
returned data belongs. 

Next instruction requests are propagated firom the next instruction 
pointer 100 to the ii\struction TLB 102, which performs an address lookup 
operation, and delivers a physical address to the unified cache 44. The 
unified cache 44 delivers a corresponding macroinstruction to the instruction 
sbreaming buffer 106, Each next instruction request is also propagated 
directly from the next instruction pointer 100 to the instruction streaming 
buffer 106 so as to allow the instruction streaming buffer 106 to identify the 
thread to which a macroirotruction received from (lie unified cache 44 
belongs. The macroinstructions from both first and second threads are then 
issued from the instruction streaming buffer 106 to the instruction pre- 
decoder 108, which performs a number of length calculation and byte 
marking operations with respect to a received insbixiction stiream (of 
macroinstructions). Specifically, the instruction pre-decoder 108 generates a 
series of byte marking vectors that serve, inter alia, to demarcate 
macroinshructions within the instruction stream propagated to the iiwtruction 
steering logic 110. 

The insboiction steering logic 110 then utilizes the byte marking 
vectors to steer discrete macroinstructions to the instruction decoder 112 for 
the purposes of decoding. Macroinstructions are also propagated from tt\e 
inshrucHon steering logic 110 to the branch address calculator 114 for the 
purposes of branch address calculation. Microirtstructions are then delivered 
from the insbruction decoder 112 to the trace delivery engine 60. 

During decoding, flow markers are associated with each 
microinstruction. A flow marker indicates a characteristic of the associated 
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microinstruction and may, for example, indicate the associated 
microinstruction as being the first or last microinstruction in a microcode 
sequence representing a macroinstruction. The flow markers include a 
"beginning of macroinstruction" (BOM) and an "end of macroinstruction" 
(EOM) flow markers. According to the present invention, the decoder 112 
may further decode the microinstructions to have shared resource 
(multiprocessor) (SHRMP) flow markers and synchronization (SYNC) flow 
markers associated therewith. Specifically, a shared resource flow marker 
identifies a microinstruction as a location within a particular thread at which 
the thread may be interrupted (e.g., re-started or paused) with less negative 
consequences than elsewhere in the thread. The decoder 112, in an exemplary 
embodiment of the present invention, is constructed to mark 
microinstructions that comprise the end or the begiiiiung of a parent 
macroinstruction with a shared resource flow marker. A synchronization 
flow market identifies a microinstruction as a location within a particular 
thread at which the thread may be synchronized with another thread 
responsive to, for example, a synchronization instruction within the other 
thread. 

From the microinstruction translation engine 54, decoded instructions 
(i.e., microinstructions) are sent to a trace delivery engine 60. The trace 
delivery engine 60 includes the trace cache 62, a trace branch predictor (BTB) 
64, a microcode sequencer 66 and a microcode (uop) queue 68. The trace 
delivery engine 60 functions as a microinstruction cache, and is the prinuiry 
source of microinstructions for a downstream execution unit 70. By 
providing a microinstruction caching function within the processor pipeline, 
the trace delivery engine 60, and specifically the trace cache 62, allows 
translation work done by the microinstruction translation engine 54 to be 
leveraged to provide an increased microinstruction bandwidth. In one 
exemplary embodiment, the trace cache 62 may comprise a 256 set, 8 way set 
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associate memory. The term "trace", in the present exemplary embodiment, 
may refer to a sequence of nucroiristructior\s stored within entries of the trace 
cache 62, each entry including pointers to preceding and proceeding 
microinstructions comprising the trace. In this way, the trace cache 62 
facilitates high-performance sequencing in that the address of the next entry 
to be accessed for the purposes of obtaining a subsequent microinstruction is 
known before a current access is complete. Traces may be viewed as "blocks" 
of instructions that are distinguished from one another by trace heads, and 
are termiiwted upon encoimtering an indirect branch or by reaching one of 
many present threshold conditions, such as the number of conditioned 
branches that may be accommodated in a single trace or the maximum 
ntamber of total microinstructioi\s that may comprise a trace. 
The trace cache branch prediction unit 64 provides local branch predictions 
pertaining to traces within the trace cache 62. The trace cache 62 and the 
microcode sequencer 66 provide microinstructions to ttie microcode queue 68, 
from where the microinstructioi« are then fed to an out-of-order execution 
cluster. The microcode sequencer 66 furthermore includes a number of event 
handlers embodied in microcode, that implement a number of operations 
within the processor 30 in response to the occurrence of an event such as an 
exception or an interrupt. The event handlers 67 are invoked by an event 
detector (not shown) included within a register renamer 74 in the back end of 
the processor 30. 

The processor 30 may be viewed as having an in-order front-end, 
comprising the bus interface unit 32, the memory execution unit 42, the 
miaoinstruction translation engine 54 and the trace delivery engine 60, and 
an out-of-order back-end that will be described in detail below. 

Microinstructions dispatched from the microcode queue 68 are 
received into an out-of-order cluster 71 comprising a scheduler 72, the register 
renamer 74, an allocator 76, a reorder buffer 78 and a replay queue 80. The 
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scheduler 72 includes a set of reservation stations, and operates to schedule 
and dispatch microiristructions for execution by the execution unit 70. The 
register renamer 74 performs a register renaming function with respect to 
hidden integer and floating point registers (that may be utilized in place of 
any of the eight general purpose registers or any of the eight floating-point 
registers, where a processor 30 executes the Intel Architecture instruction set). 
The allocator 76 operates to allocate resources of the execution unit 70 and the 
cluster 71 to microinstructions according to availability and need, bi ttie 
event that iiisuffident resources are available to process a microinstruction, 
the allocator 76 is responsible for asserting a stall signal 82, that is propagated 
through the trace delivery engine 60 to the microinstruction translation 
engine 54, as shown at 58. Microinstructions, which have had their sovaoe 
fields adjusted by the register renamer 74, are placed in a reorder buffer 78 in 
strict program order. When microinstructions within the reorder buffer 78 
have completed execution and are ready for retirement, they are then 
removed firom the reorder buffer 162. The replay queue 80 propagates 
microinstructions that are to be replayed to the execution unit 70. 

The execution imit 70 is shown to include a floating-point execution 
engine 84, an integer execution engine 86, and a level 0 data cache 88. In one 
exen^lary embodiment in which is the processor 30 executes the Intel 
Architecture instruction set, the floating point execution engine 84 may 
further execute MMX® instructions. 

Multithreading Implementation 
In the exemplary embodiment of the processor 30 illustrated in Figure 
2, there may be limited duplication or replication of resources to support a 
mxaltithreading capability, and it is accordingly necessary to implement some 
degree of resource sharing between threads. The resource sharing scheme 
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employed, it will be appreciated, is dependent upon the number of threads 
that the processor is able simultaneously to process. As functional uruts 
within a processor typically provide some buffering (or storage) functionality 
and propagation functionality, the issue of resource sharing may be viewed as 
comprising (1) storage and (2) processing/propagating bandwidth sharing 
components. For example, in a processor that supports the simultaneous 
processing of two threads, buffer resources within various functional units 
may be statically or logically partitioned between two threads. Similarly, Ihe 
bandwidth provided by a path for flie propagation of information between 
two functional units must be divided and allocated between the two threads. 
As these resource sharing issues may arise at a number of locations within a 
processor pipeline, different resource sharing schemes may be employed at 
these various locations in accordance with the dictates and characteristics of 
the specific location. It will be appreciated that different resource sharing 
schemes may be suited to different locations in view of varying functionalities 
and operating characteristics. 

Figure 3 is a block diagram illustrating selected components of the 
processor 30 illustrated in Figure 2, and depicts various functional units that 
provide a buffering capability as being logically partitioned to accommodate 
two threads (i.e., thread 0 and thread 1). The logical partitiorung for two 
threads of tihe buffering (or storage) and processing facilities of a functional 
xmit may be achieved by allocating a first predetermined set of entries within 
a buffering resource to a first thread and allocating a second predetermined 
set of entries within the buffering resource to a second thread. Specifically, 
this may be achieved by providing two pairs of read and write pointers, a first 
pair of read and write pointers being associated with a first thread and a 
second pair of read and write pointers being associated with a second thread. 
The first set of read and write pointers may be limited to a first 
predetermined number of entries within a buffering resoiu-ce, while the 
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second set of read and write pointers may be limited to a second 
predetermined number of entries within the same buffering resource. In the 
exemplary embodiment, the instruction streaming buffer 106, the trace cache 
62, and an instruction queue 103 are shown to each provide a storage capacity 
that is logically partitioned between the first and second threads. Each of 
these imits is also sown to include a "shared" capacity that may, according to 
respective embodiments, be dynamically allocated to either the first or the 
second thread according to certain criteria. 

Trace Delivery Engine 

One embodiment of the present invention is described below as being 
implemented within a trace delivery engine 60, and specifically with respect 
to a trace cache 62. However, it will be appreciated that the present invention 
may be applied to a partition any resources within or associated with a 
processor, and the trace delivery engine 60 is merely provided as an 
exemplary embodiment. 

As alluded to above, the trace delivery engine 60 may function as a 
primary source of microinstructions during periods of high performance by 
providing relatively low latency and high bandwidth. Specifically, for a CISC 
instruction set, such as the Intel Architecture x86 instruction set, decoding of 
macroinstructions to deliver microinstructions may introduce a performance 
bottleneck as the variable length of such instructions complicates parallel 
decoding operations. The trace delivery engine 60 attempts to address this 
problem to a certain extent by providing for the caching of microinstructions, 
thus obviating the need for microinstructions executed by the execution imit 
17 to be continually decoded. 

To provide high-performance sequencing of cached microinstructions, 
the trace delivery engine 60 creates sequences of entries (or microinstructions) 
that may conveniently be labeled "traces". A trace may, in one embodiment, 
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facilitate sequencing in that the address of a subsequent entry can be known 
during a current access operation, and before a current access operation is 
complete. In one embodiment, a trace of microinstructions may only be 
entered through a so-called "head" entry, that includes a linear address that 
determines a set of subsequent entries of the trace event stored in successive 
sets, with every entry (except a tail entry) containing a way pointer to a next 
entry. Similarly, every entry (except a head entry) contains a way pointer to a 
previous entry. 

In one embodiment, the trace delivery engine 60 may implement two 
modes to either provide input thereto or output therefrom. The trace delivery 
engine 60 may implement a ''build mode" when a miss occurs with respect to 
a trace cache 62, such a miss being passed on to the microinstruction 
translation engine 54. In the "build mode", the microinstruction translation 
engine 54 will then perform a translation operation on a macroinstruction 
received either from the unified cache 44, or by performing a memory access 
operation via the processor bus. The microinstruction translation engine 54 
then provides the microinstructions, derived from the macroinstruction(s), to 
the trace delivery engine 60 which populates the trace cache 62 with these 
microiitstructions. 

When a trace cache hit occurs, the trace delivery engine 60 operates in 
a "stream mode" where a trace, or traces, of microinstructions are fed from the 
trace delivery engine 60, and specifically the trace cache 62, to the processor 
back end via the microinstruction queue 68. 

Figure 4 is a block diagram showing further details regarding the 
various components of the trace delivery engine (TDE) 60 shown in Figure 2. 
The next instruction pointer 100, which forms part of the microinstruction 
translation engine 54, is shown to receive a prediction output 65 from the 
trace branch prediction unit 64. The next instruction pointer 100 provides an 
instruction pointer output 67, which may correspond to the prediction output 

15 



wo 01/77820 



PCT/USOl/01577 



65, to the trace cache 62. 

A trace branch address calculator (TBAC) 120 monitors the output of 
the microsequencer microinstruction queue 68, and performs a number of 
functions to provide output to a trace branch irtformation table 122. 
Specifically, the trace branch address calculator 120 is responsible for bogus 
branch detection, the validation of branch target and branch prediction 
operations, for computing a Next Linear Instruction Pointer (NIUP) for each 
instruction, and for detecting limit violations for each instruction. 

The trace branch iriformation table (TBIT) 122 stores information 
required to update the trace branch prediction imit 64. The table 122 also 
holds information for events and, in one embodiment, is hard partitioned to 
support multithreading. Of course, in an alternative embodiment, the table 
122 may be d3mamically partitioned. 

The trace branch information table 122 provides input to a trace branch 
target buffer (trace BTB) 124 that operates to predict "leave trace" conditions 
and "end-of-trace" branches. To this end, the buffer 124 may operate to 
invalidate microinstructions. 

When operating in the above-mentioned 'build mode", 
microinstructions are received into the trace cache 62 via a trace cache fill 
buffer (TCFB) 125, which is shown in Figure 4 to provide input into the trace 
cache 62. 

Figure 5 is a block diagram illustrating further architectural details of 
the trace cache fill buffer 125. In one embodiment of the buffer 125 includes 
first and second buffers 134 and 136, each of which is dedicated to a specific 
thread (e.g., thread 0 and thread 1). Each of the buffers 134 and 136 provides 
four (4) entries for an associated thread, and outputs microinstructions to a 
staging buffer 138, from where the microinstructions are commimicated to the 
trace cache 62. The trace cache fill buffer 125 implements a build algorithm in 
hardware that realizes the "build mode", and provides microinstruction 
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positioning, and the detection of "end-of-line" and "end-of-trace" conditions. 

The trace cache 62 is shown in Figure 4 to include a data array 128 and 
an associated tag array 126. The data array 128 provides a storage for, in one 
embodiment, 12 KB of microinstructions. 

Figure 6 is a block diagram illustrating further architectural details 
pertinent to the ti-ace cache 62. The thread selection logic 140 implements a 
thread selection state machine that, in one embodiment, decides on a cyde- 
by-cycle basis which of multiple threads (e.g., thread 0 or thread 1) is 
propagated to subsequent pipe stages of a processor 30. 

Figure 6 also illustrates the partitiorung of the trace cache 62 into three 
portioi\s (or sections), namely a first portion 148 dedicated to a first thread, a 
second portion 152 dedicated to a second thread, and a third portion 150 that 
is dyiuimically shared between the first and second threads. In the exemplary 
embodiment, each of the first and second portions 148 and 152 comprises two 
(2) ways of the data array 128 (and the associated tag array 126) of the trace 
cache 62. The tiiird, shared portion 150 constitutes four (4) of title data array 
128, and the associated tag array 126. The illushrated partitioning of the trace 
cache 62 is implemented by victim selection logic 154, which will be described 
in further detail below. 

Figure 7 is a block diagram illustrating an exemplary structure of the 
h-ace cache 62, according to one embodiment. Each of the tag array 126 and 
the data array 128 are each shown to comprise an eight-way, set associative 
arrangement, including 256 sets thus providing a total of 2048 enbries within 
each of the tag and data arrays 126 and 128. Each enhy 148 witiiin the tag 
array 126 is show to store, inter alia, tag field information 151, a thread bit 153, 
a valid bit 155 and a Least Recently Used (LRU) bit 240 for each 
corresponding enta-y 156 within the data 128. The thread bit 153 marks the 
data within the associated entiry 156 as belonging, for example, to either a first 
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or a second thread. The valid bit 155 marks the data within the 
corresponding entry 156 of the data array 128 as being valid or invalid. 

One embodiment of the trace cache 62 may also include a further 
minitag array 127, as illustrated in Figure 7, that is a subset of the full tag 
array 126 and that is utilized to perform high-speed tag match operations and 
for reducing power consumption related to performing a lookup with respect 
to the trace cache 62. A hit on the minitag array 127 may be regarded as 
"mutually exclusive", as will be described in further detail below. 

Thread Selection Logic 

Dealing first v/ith the thread selection logic 140, which detertnines, 
inter alia, the output of the trace cache 62, Figure 8 is a block diagram 
illustrating the various inputs and outputs of the thread selection logic 140. 
The thread selection logic 140 is shown to take inputs from (1) a trace cache 
build engine 139, located in the microinstruction translation engine interface, 
(2) the microinstruction queue 68 and (3) trace cache /microsequencer control 
logic 137. Utilizing these inputs, the thread selection logic 140 attempts to 
generate an advantageous thread selection (e.g., thread 0 or thread 1) for a 
particular cycle. Thread selection, in one embodiment, is performed on a 
cycle-by-cycle basis and attempts to optimize performance while not starving 
either thread of processor resources. 

The output of the thread selection logic 140 is shown to be 
communicated to the microcode sequencer 66, the trace branch prediction 
unit 60 and the trace cache 62 to affect thread selection within each of these 
units. 

Figure 9 is a block diagram illustrating three components of the thread 
selection logic 140, namely a thread selection state machine 160, a counter and 
comparator 162 for a first thread (e.g., thread 0) and a further counter and 
comparator 164 for a second thread (e.g., thread 1). 
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The thread selection state machine 160 is shown to receive build and 
mode signals 161, indicating whether the processor is operating in a 
multithreaded (MT) or a single threaded (ST) mode and if operating in a 
multithreaded mode, indicating whether or not each thread is in a build 
mode. The thread selection state machine 160 is also shown to receive 
respective full inputs 172 and 174 from the counter and comparator units 162 
and 164. The full signals 172 and 174 indicate whether a threshold number of 
microinstructions for a particular thread are within the trace delivery engine 
160. In one embodiment, each of the uruts 162 and 164 allow a total 4X6 
microinstruction lines within the trace delivery engine 60. The full sigiwls 172 
and 174 are routed to all the unite within tfie trace delivery engine 160, 
responsive to which such units are responsible for recycling their states. Each 
of the counter comparator vinits 162 and 164 is shovm to receive a queue 
deallocation sigiwl 166 from the microcode sequencer 66, a collection of dear, 
nuke, reset and store signals 168 and valid bite 170 from the trace cache tag 
array 126. 

Figure 10 is a state diagram illustrating operation of the thread 
selection state machine 160, illustrated in Figure 9. When in multithreading 
mode, the state machine attempte to time-multiplex multiple threads on a 
cycle-by-cycle basis. When a thread encounters a relatively long stall, the 
state machine 160 attempte to provide full bandwidth to the thread that has 
not stalled. When multiple threads (e.g., thread 0 and thread 1) experience 
long latency stalls, the state machine 160 may, in certain drcunnstances, 
require a one-cycle bubble (e.g., if both threads are stalled and the state 
machine 160 is in "thread 0" state and a "thread 1" stall is removed). 

Referring back to Figure 6, it will be noted that the selection signal 141, 
outputted from the thread selection logic 140, is not itself regarded as a "valid 
bit", but is rather used as a 2-1 MUX selection control to the MUX 142. The 
MUX 142 operates to select between control signals outputted from a first 
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thread control 144. and a second thread control 146. The outputs of the 
controls 144 and 146 are dependent upon valid bits being set for the relevant 
threads. For example, the selection signal 141 may indicate a thread entry for 
a particular thread (e.g., thread 0) to be outputted from the trace cache 62. 
However, the valid bit for the relevant entry may be set to 0, indicating an 
invalid entry. 

Victim Selection Logic 

The partitioning of the trace cache 62, as illustrated in Figure 6, may, 
in one embodiment, be implemented by the victim selection logic 154. The 
victim selection logic 154 is responsible for identifying the way (in bofli the 
tag array 126 and the data array 128) to which a microinstruction is written. 

Figure 11 is a block diagram illustrating architectural details of one 
embodiment of the victim selection logic 154. The victim selection logic 154 is 
shown to include minitag victim selection logic 180, valid victim selection 
logic 182 and Least Recently Used (LRU) victim selection logic 184. A priority 
multiplexing operation is performed on the outputs of the selection logics 180, 
182 and 184 by a priority MUX 186. The priority ordering implemented by 
the priority MUX 186 is as follows: 

1. Minitag victim; 

2. Valid victim; and 

3. LRU victim. 

A multi-threaded latch structure 190 is used to pass the results of the 
priority MUX to the trace cache 62. 

Figure 12 is a flow chart illustrating an exemplary method 200, 
according to one embodiment, of partitioning a memory resource, such as for 
example, the trace cache, within a multi-threaded processor. The operation of 
the various units of the victim selection logic 154 illustrated in Figure 11 will 
be described with reference to the flow chart shown in Figure 12. 

The method 200 commences at block 202 where the minitag victim 
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selection logic 180 performs a minitag victim determination with respect to 
the minitag array 127. Specifically, the logic 180 attempts to identify a conflict 
between an existing valid minitag array entry and a current instruction 
pointer (e.g., the current Linear Instruction Pointer (CUP)). 

At decision box 204, a determination is made as to whether a miiutag 
victim was located at block 202. If so, the method 200 advances to block 212, 
where relevant trace cache data (e.g., a microiiistruction) is written to the 
identified victim entry within the trace cache 62. As a miiutag hit is regarded 
as being "mutually exclusive", an identified minitag victim is given tiie 
highest priority by the victim selection logic 154. 

Following a negative determination at decision box 204, at block 206, a 
valid victim determination operation is performed by the valid victim 
sdection logic 182. This operation involves simply identifying an invalid 
entry within the trace cache 62 by examiiung valid bits 155 stored within the 
tag array 126 of the trace cache 62. Following a positive determination at 
decision box 208, the method 200 advances to block 212. On the other hand, 
following a negative detemrunation (i.e,, no invalid entries are identified) at 
decision box 208, the nwthod 200 proceeds to box 210, where a LRU victim 
detemrdiuition operation is performed. Following completion of the operation 
at block 210, the method 200 again advances to block 212. The method 200 
then terminates at step 214. 

Figure 13 is a flow chart illustrating an exemplary method 210, 
according to one embodiment, of partitioning a resource, in the exemplary 
form of a memory resource, utilizing a LRU history associated with the 
relevant memory resource. 

Figure 14 is a block diagram illustrating an exemplary LRU history 240 
that may be utilized in the performance of the method 210, the execution of 
which will be described with reference to Figure 10. 

The method 210 commences at block 222 with the receipt of a 



21 



wo 01/77820 



PCT/USOl/01577 



miCToinstruction, and associated tag information, at the victim selection logic 
154. 

At block 224, a set into which the miaoinstruction may potentially be 
written is identified (e.g., by a write pointer). 

At block 226, having identified a victim set, the LRU victim selection 
logic 184 examines the LRU history for the relevant set. Figure 14 illustrates 
the LRU history 240, as maintained within the tag array 126 of the trace cache 
184, the LRU history 240 containing a LRU history for each set within the data 
array 128. 

At decision box 228, tiie LRU victim selection logic 184 determines 
whether the tail entry, indicating a specific way within the set, is available to a 
relevant thread (e.g., thread 0 or thread 1). As mentioned above, in an 
exemplary embodiment, ways 0 and 1 may be available exclusively to a first 
thread (e.g., thread 0), ways 6 and 7 may be available exclusively to a second 
thread (e.g., thread 1) and ways 2-5 may be dynamically shared multiple 
threads. Referencing the exemplary LRU history for a set N, way 6 is 
indicated by the tail entry as being the least recently used way in the relevant 
set N. Assume, for example, that the microinstruction to be cache belongs to a 
first thread (e.g., thread 0) in which way 6 would not be available to receive 
the microinstruction on account of way 6 having been dedicated exclusively 
to tihe storage of miaoinstructions for a second thread (e.g., thread 1). 

Returning to Figure 13, following a negative determination at 
decisions box 228, the LRU victim selection logic 184 proceeds to examine 
entries within the LRU history 252 for the relevant set behind the tail entry to 
identify a way that may receive the microinstruction for the relevant thread. 
As indicated at block 230, the LRU victim selection logic 184 examines a 
predetermined set M of tail entries (e.g., the three enbies closest to the tail of 
the LRU history 252 for the set) to locate a way, closest to the tail of the LRU 
history, that is available to the relevant thread. 
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In the example provided in Figure 14, the next-to-last entry within the 
LRU history for the relevant set identifies way 3 which, under the scheme 
described above, would be available to receive a miaoinstruction for a first 
thread (e.g., thread 0) as way 3 is located in the "shared" portion of the trace 
cache 62. 

Figure 14 illustrates how the entry for way 3, within the LRU history 
252 for the relevant set, is moved to the head of the LRU history 252 on 
accoxmt of this way being designated for storage of the relevant 
microinstruction- 
Returning to the flow chart in Figure 13, at block 232, the victim entry 
(i.e., the victim way) within the relevant set that is available to the relevant 
thread is identified, and the microinstruction written to that way within the 
set. The method 220 then ends at step 234. 

Figure 15 is a block diagram illustrating further details regarding the 
inputs to, and output from, the victim selection logic 184. The victim selection 
logic 184, in one embodiment, comprises discrete logic components that 
implement the methodology described above. In an alternative embodiment, 
the victim selection logic 184 may execute code to implement the described 
methodology. Specifically, the logic is shown to receive a 7-bit pending 
multi-thread (PENDING.MT) signal 250, a 28-bit least recently used (LRU) 
signal 252, a second thread status (NTl) signal 254 and a first thread status 
(MTO) signal 256 as inputs. The signal 250 indicates the way selected to 
receive a micro-instruction of a current thread or further thread (other than a 
thread currently being considered) by the selection logic 184 as indicated by 
the selection logic 184 during a previous victim selection operation, or as 
determined by further victim selection logic 154 associated with the further 
thread. The signal 250 is utilized by the LRU victim selection logic 184 to 
insure that the selection logic 184 does not "doubly select" the same way 
between two threads, or that multiple LRU victim selection logics 184 do not 
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select the same way between two threads. To this end, the victim selection 
logic 184 implements discrete logic that prevents it from selecting the same 
way as indicated by the signal 250. 

The signal 250 accordingly, in one embodiment, indicates the way that 
was previoiisly selected as a victim, while the LRU signal 252 provides the 
LRU history 252 for the relevant set to the logic 184. The status signals 254 
and 256 indicate to the logic 184 which of the threads are "alive" or executing 
within a processor 30. The logic 184 then outputs a 7-bit selection signal 260 
for a relevant set, indicating the way within a relevant set to which tiie 
microinstruction should be written for caching purposes within the trace 
cache 62. 

By implementing a pseudo-dynamic partitioning of a resource, such as 
the trace cache 62, the present invention ensures that a certain predetermined 
minimum threshold of the capacity of a resource is cdways reserved and 
available for a particular thread within a multithreaded processor. 
Nonetheless, by defining a "shared" portion that is accessible to both threads, 
the present invention facilitates dynamic redistribution of a resource's 
capacity between multiple threads according to the requirements of such 
threads. 

Further, the LRU victim selection methodology discussed above 
enables hits to occur on ways allocated to a further thread, but simply 
disallows the validation of such a hit, and forces the LRU victim selection 
algorithm to select a further way, according to an LRU history, that is 
available to a particular thread. 

As mentioned above, the logic for implementing any one of the 
methodologies discussed above may be implemented as discrete logic within 
a functional unit, or may comprise a sequence of ir\structions (e.g., code) that 
is executed within the processor to implement the method. The sequence of 
instructior\s, it will be appreciated, may be stored on any medium from which 
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it is retrievable for execution. Examples of these mediums may be a 
removable storage medium (e.g., a diskette, CD-ROM) or a memory resource 
associated with, or ir\duded within, a processor (e.g.. Random Access 
Memory (RAM), cache memories or the like). Accordingly, any such medium 
should be regarded as comprising a "computer-readable" medium and may 
be included in a processor, or accessible by a processor employed within a 
computer system. 

Thus, a method and apparatus for partitioiung a processor resource 
within a multi-threaded processor have been described. Although the present 
invention has been described witii reference to specific exemplary 
embodiments, it will be evident that various modifications and changes may 
be made to these embodiments without departing from the broader spirit 
scope of the invention. Accordingly, the specification and drawings are to be 
regarded in an illustrative rather than a restrictive sense. 



25 



wo 01/77820 



PCT/USOl/01577 



WHAT IS CLAIMED: 



1. A method including: 

dedicating a first portion of a resource exclusively to a first thread; 

dedicating a second portion of the resource exclusively to a second 
thread; and 

dynamically sharing a third portion of the resotirce between the first 
and second threads. 



2. The method of claim 1 wherein the d3mamic sharing of the third 
portion of the resource is performed according to resource demands of the 
respective first and second threads. 

3. The method of claim 1 wherein the resource comprises a memory 
resource including first and second portions dedicated to the first and second 
threads respectively and a third portion shared between the first and second 
threads, the method including: 

identifying a first location within the memory resource as a candidate 
location to receive an information item associated with the first thread; 

determiiung whether the candidate location is within the first or the 
third portion of the memory resource dedicated to the first thread; 



if the candidate location is within the first or the third portion of the 
memory resovirce, then storing the information associated the first 
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thread at the candidate location; and 

if the candidate location is within the second portion of the memory 
resource then identifying a further location as being the candidate 
location. 

4. The method of claim 3 wherein the memory resource comprise a N 
way set associative memory and wherein the first portion comprises a first 
way dedicated to the first thread, the second portion comprises a second way 
dedicated to the second thread and the third portion comprises a third way 
shared between the first and second threads, wherein the identification of ti\e 
first location as the candidate location comprises identifying a selected way 
within a selected set of the memory as a candidate way to receive the 
information item associated with the first thread. 

5. The method of daim 4 wherein the identification of the further location 
as the candidate location comprises identifying a further way within the 
selected set of the memory as the candidate way to receive the information 
item associated with the first thread. 

6. The method of daim 4 wherein the identification of the selected way 
within the selected set as the candidate way comprises identifying a way 
within the select set that was least recently used. 

7. The method if daim 5 wherein the identification of the further way 
within the selected set a candidate way comprises identifying a way within 
the selected set that was second-least recently used. 

8. The method of daim 6 including examining a Least Recently Used 
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(LRU) history for the selected set to identify the way that was least recently 
used. 

9. The method of claim 8 including examining a set of entries within the 
LRU history for the selected set, each entry within the set of entries indicating 
a respective way within the selected set, wherein the set of entries is ordered 
in a sequence determined by least recent usage of a respective way and the 
selection of the candidate way comprises performing a sequential 
examination of the entries of the set of entries to locate a least recently used 
way that comprises either the first or the second way. 

10. The method of claim 4 wherein memory comprises a trace cache 
memory, and wherein the information item associated with the first thread 
comprises a microinstruction of the first thread. 

11. A resource comprising: 

a first portion dedicated for utilization by a first thread executing 
within a multi-threaded processor; 

a second portion dedicated to utilization by a second thread executing 
within the multi-threaded processor; and 

a third portion shared by the first and second threads. 

12. The resource of daim 11 wherein the resource comprises a memory 
including selection logic to identify a first location selection logic to identify a 
first location within the memory resource as a candidate location to receive an 
information item associated with the first thread, to determine whether the 
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candidate location is within the first or third portions of the memory resource, 
then to store the information associated the first thread at the candidate 
location but, if candidate location is within the second portion of the memory 
resource, then to identify a further location as being the candidate location. 

13. The resource of claim 12 comprising a N way set associative memory 
and within the first portion comprises a first way dedicated to the first thread, 
the second portion comprises a second way dedicated to the second thread 
and the third portion comprises a third way shared between the first and 
second threads. 

14. The resource of claim 12 wherein the selection logic identifies a 
selected way within a selected set of the memory as a candidate way to 
receive the information item associated witii the first thread if the selected 
way comprises either the first or the tiiird say. 

15- The resource of claim 12 wherein the selection logic identifies a further 
way within the selected set of the memory as the candidate way to receive the 
information item associated with the first thread if the selected way comprises 
the second way. 

16. The resource of claim 14 wherein the selection logic identifies the 
selected way within the selected set as ti:\e candidate way by identifying the 
selected way within the select set as a last recently used way within the 
selected set. 

17. The resource of claim 15 wherein the selection logic identifies the 
further way within the selected set a candidate way by identifying the hirther 
way within the selected set as a second-least recentiy used way within the 
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selected set. 

18. The resource of claim 16 wherein the selection logic examines a Least 
Recently Used (LRU) history for the selected set to identify the way that was 
least recently used. 

19. The resource of claim 18 wherein the selection logic examines a set of 
entries within the LRU history for the selected set, each entry within the set of 
entries indicating a respective way within the selected set, wherein the set of 
entries is ordered in a sequence determined by least recent usage of a 
respective way and the selection of ttie candidate way comprises performing 
a sequential examination of the entries of the set of entries to locate a least 
recently used way that comprises either the first or the second way. 

20. The resource of claim 18 wherein the memory comprising a trace cache 
memory, and wherein the information item associated with the first thread 
comprises a microinstruction of the first thread. 

21. Selection logic including: 

first means for identifying a first location within a memory resource, 
associated with a multi-threaded processor as a candidate location to 
receive an information item associated with a first thread; 

second means for determining whether the candidate location is within 
a second portion of the memory resource dedicated to the second 
thread; 

wherein, if the candidate location is within the second portion of the memory 
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resource dedicated to second thread, the first meam identifies a further 
location within the memory resource as the candidate location. 

22. The selection logic of claim 21 wherein the memory resource comprises 
an N way set associative memory and wherein the first portion comprises a 
first way dedicated to the first thread, the second portion comprises a second 
way dedicated to the second thread and the third portion comprises a third 
way shared between the first and second threads, and wherein the first means 
identifies a selected way within a selected set of the memory as a candidate 
way to receive information not associated with the first way. 

23. The selection logic of claim 22 wherein the first means identifies a 
further way within the selected set of the memory as the candidate way to 
receive information associated with the first thread. 

24. A method including: 

defining a memory resource, associated with a multi-threaded 
processor, to include first and second portions dedicated to the first 
. and second threads respectively and a third portion shared between 
the first and second threads; 

for an information item associated with the first thread, examining a 
history of least recently used portions to identify either the first or the 
third portion as being a least recently used portion available to the first 
thread; and 

storing the information item within the least recently used portion. 

25. The method of claim 24 wherein, for the information item associated 
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with the first thread, the second portion is excluded from the identification as 
the least recently used portion on account of being dedicate to the second 
thread. 

26. The method of claim 24, wherein the memory resource comprises a N 
way set associative cache memory and wherein the first, second and third 
portions comprising respective first, second and third ways. 

27. The method of claim 26 wherein the examination of the history of least 
recently used portions includes examining a least recently used history for a 
selected set of the set associative cache memory. 

28. The method of claim 24 wherein the cache memory comprises a trace 
cache memory, and wherein the information item associated with the first 
thriead comprises a microinstruction of the first thread. 

29. A computer-readable medium storing a sequence of instructions that, 
when executed within a processor, causes the processor to perform the steps 
of: 

dedicating a first portion of a resource exclusively to a first thread; 

dedicating a second portion of the resource exclusively to a second 
thread; and 

dynamically sharing a third portion of the resource between the first 
and second threads. 

30. The computer readable medium of claim 29 wherein the dynamic 
sharing of the third portion of the resources is performed according to 
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resoiirce demands of the respective first and second threads. 
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